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A lot has changed in the world over the last decade: social media, U.S. presidents, electric cars, health care 
options, big data, 4K TVs, the economy, just to name a few. Similarly, a lot has changed in the preemployment 
assessment world within the last 10-12 years. Advances in technology have been at the core of many of these 
changes as practices evolve and have created opportunities for organizations to better select quality hires. 
However, one thing that has not changed is the war for talent: companies competing for the best candidates to 
fill their available job positions. Given these changes, a key question remains: What are these new trends, or big 
ideas, in the preemployment arena, and are these trends appropriate for all companies? This paper will intro- 
duce five prominent preemployment assessment trends and focus on the pros and cons of these trends that 
are impacting the way companies select candidates in today’s world. Although some of these trends have been 
around longer than this past decade, there has been much focus on their advancement as the world, itself, con- 
tinues to evolve. These preemployment assessment trends include (a) unproctored internet testing (UIT), (b) ap- 
plicant tracking systems, (c) gamification, (d) mobile-enabled assessments, and (e) applicant reactions. With the 
ongoing search for quality talent, these trends can enable companies to find top candidates faster, hire those 
who are a better fit for their roles, and ensure that candidates have a positive selection process experience. By 
leveraging the extensive skill set of industrial-organizational (I-O) psychologists, companies can examine how 
these trends can impact them through a logistical, fiscal, legal, and professional lens. 


Unproctored Internet Testing 


One of the most significant technological developments in the last decade to change the way preemploy- 
ment tests are administered is unproctored Internet testing (UIT). In UIT conditions, a physical human test 
administrator does not monitor the testing event, clearly different from proctored settings. Rather, the assess- 
ments are completed online at a location of the applicant’s choice. UIT opens many avenues regarding the test- 
ing of job candidates, such as being able to test thousands of applicants simultaneously, having assessments 
scored within seconds, and providing quick results to hiring professionals. However, this may also create addi- 
tional concerns, such as allowing the applicant to confer with others about their responses, looking up infor- 
mation for how to respond, and sharing test content with other applicants, which might affect the standardiza- 
tion and security of the assessment. Nonetheless, UIT is increasingly being used, and there are both pros and 
cons to implementing UIT into an organization’s preemployment selection process that warrant consideration. 


Pros Cons 
e Measurement considerations e Measurement considerations 
e Proctored and unproctored noncognitive assessments e May be more susceptible to the test containing extrane- 
have similar, and typically good, accuracy predicting job ous information not relevant to the job domain. 
performance (Beatty, Nye, Borneman, Kantrowitz, Dras- e Less standardization of assessment. 
gow, and Grauer; 2011). e Although low, the risk of cheating is still present (e.g., 
e Actual cheating rates on UITs appear relatively low (Tip- looking up answers to knowledge tests, have someone 
pins, 2015). else complete the assessment). 
e Operational characteristics e Operational characteristics 
e Assess large volumes of job candidates simultaneously. e Candidates must have access to a computer or mobile 
e Greater pool of job applicants. device and the internet. 
e Ideal for multiple remote locations. e Equipment and/or software malfunctioning. 
e Assessment can be accessed and taken any time (i.e., e Applicants’ identifty/performance is not verified by a 
24/7, 365 days a year). proctor (Tippins, Beaty, Drasgow, Gibson, Pearlman, 
e No need for physical storage and security of paper-and- Segall, & Shepherd, 2006). 
pencil assessments. e Candidates need to be computer/technically savvy. 
e Saves time and cost of proctors and need for testing 
facilities. 
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Although first developed in the 1990s, applicant tracking systems (ATSs) have become the standard for 
collecting and storing volumes of applicant data and information. This includes application forms, assessments, 
and other candidate information (e.g., military veteran status, family member working with company, and/ 
or valid driver’s license). Much has changed over the years for ATSs, particularly in their capability to integrate 
assessments. There are now a variety of ATSs that organizations can select from and decide which system will 
best fit the needs of their company. Some online resources (e.g., Software Advice, Technology Advice, and PC 
Mag list the different capabilities of particular ATSs for easy comparison. If a company decides to utilize an ATS, 
these resources may help determine which system is best to implement. ATSs may be most ideal for medium 
to large companies due to their large applicant pools and the amount of information for each applicant file, 
but smaller companies may also benefit. For example, ATSs can make it easier to track EEO hiring requirements 
(Schlinger, 2014) rather than doing this manually using a spreadsheet. 


Applicant Tracking Systems 


Pros Cons 


e Measurement considerations ° 


e Can present assessments early in the selection process to 
weed out poor fits for the job. 

e Unifies the platform for multiple company locations. 

e Help maximize recruitment and provide vigorous report- 
ing and big data analyses (Halutzy, 2016). 

Operational characteristics 

e Eliminates the need for paper reporting, thus lower 
administrative costs. 

e Improves an organization’s time-to-hire/tracks multiple 
recruiting lines (Halutzy, 2016). 

e Track and store large quantity of data on a large pool of 
candidates. 

e Can be customized to fit the needs of organizations 
(Schlinger, 2014). 

e Generate emails to candidates automatically (i.e., assess- 
ment reminders, autoreplies). 

e Creates reports on candidate data (i.e., pass rates, com- 
pletion rates). 

e Automatic legal and compliance tracking rather than 
manually. 

e Merges application/resume and assessment, which can 
lead to less applicant dropout. 


Advances in technology have... 
created opportunities for 
organizations to better select 
quality hires. 


Measurement considerations 

e ATScan be inaccurate (e.g., resumes being rejected be- 
cause scanner is not reading resumes properly) 

e May screen out some well-qualified candidates if appli- 
cants do not format their resumes to be recognizable 
by the ATS, which is a concern, in particular, for non-tra- 
ditional job applicants (e.g., veterans; Verhaag, 2015; 
Schlinger, 2014). 

Operational characteristics 

e Likely need internal experts to create settings and trou- 
bleshoot issues. 

e Vendor cost of installing/integrating the ATS and the cost 
of training users of the ATS. 

e Many people not qualified for the job submit their 
resumes. 

e Less personable perceptions of organization by job can- 
didates. 

e Servers can go down leading to a poor applicant experi- 
ence (though this is infrequent). 
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Gamification 


Gamification is the practice of adding game-like characteristics to assessments to make them more appeal- 
ing to candidates. Rather than simply asking behavioral or personality questions of applicants, gamification 
adds features such as rules; competition; scores; medals, badges, or trinkets won; levels of progress; and com- 
parisons of performance against other “players,” typically in work-related scenarios. The intent is to provide 
a more captivating candidate experience that assesses specific skills while keeping the applicant engaged. 

For example, Kapp (2014) describes the utilization of gamification in selection for the cyber security industry: 
Applicants compete against one another in completing a series of challenges, such as breaching computer sys- 
tems and networks. Kapp (2014) explains that gamification was chosen to assess the applicants’ knowledge of 
network software, creative approaches to various breaches, and ability to think quickly under pressure, qual- 
ities not always best measured through education degree or grade point average. Gamification has produced 
positive outcomes for different populations (e.g. military, healthcare, government) and is becoming a popular 
method for achieving business goals (Fetzer, 2015; Duvernet & Popp, 2014). 


Pros Cons 
e Measurement considerations e Measurement considerations 
e Gamification allows applicants to demonstrate how e May not be long enough to adequately sample enough 
they apply their knowledge, and allows organizations to behavior to generalize findings. 
evaluate applicants in multiple areas, such as personality, e Need more empirical testing in accuracy of job perfor- 
problem-solving skills, and ability to multitask and stay mance predictivity and accuracy in general. 
focused (Kapp, 2014). e Arthur, Doverspike, Kinney, and O’Connell (2017) report- 
e Makes assessments seem like a game so applicants may ed that they could not find any empirical investigations 
be more engaged in the process. of gamification. 
e Can bea realistic preview of the job/elements of the job. e Operational characteristics 
e Operational characteristics e Depending on how advanced the organization wants the 
e Time spent taking assessments is perceived to be less. game elements (e.g., well-developed storyline), some 
e Typically appeals to and attracts younger job candidates. technological requirements, resources, and game- 
e May create favorable impressions regarding tech savvi- element developments may be costly (Callan, Bauer, & 
ness of organization Landers, 2015) as would the creation of alternate forms 
e Can relieve some tensions associated with selection tests and/or other methods to thwart cheating (e.g., maximiz- 
and assessments. ing interactive problem solving, uncertainty within the 


game; Fetzer, 2015). 

e Possibility of security breaches. 

e May not appeal to or attract older job candidates as 
much or candidates who prefer keeping work and play 
separate. 


Mobile-Enabled Assessments 


Mobile devices (e.g., smartphones, tablets) are growing faster than the number of people who own them 
(Mack, 2014; Mamilt, 2014) and, as Illingworth, Morelli, Scott, and Boyd (2015) explain, according to industry 
and technology trends, mobile device usage will continue to substantially increase. Because of this, organiza- 
tions have responded to this increasing trend and are adapting their recruitment and selection processes to 
be mobile-enabled. According to Arthur, Keiser, and Doverspike’s (2016) Structural Characteristics/Informa- 
tion Processing (SCIP) model that classifies Internet-based testing devices on a continuum, mobile devices are 
at the high end of information processing. Integrating mobile device assessments into the selection process 
may be beneficial for some organizations, but there are also drawbacks to utilizing mobile devices as a testing 
platform (see Lawrence and Kinney’ [2017] hot topic paper on mobile assessments for a deeper look at mo- 
bile-enabled assessments). 
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Pros Cons 
e Measurement considerations e Measurement considerations 
e Scores ona personality measure were similar for both e More psychometric equivalence evidence of the assess- 
mobile and nonmobile devices (Arthur, Doverspike, Mu- ment versions (i.e., PCs, tablet, smartphones) needs to 
noz, Taylor, & Carr; 2014). be established and measurement equivalence between 
e No mean differences between mobile and nonmobile de- mobile vs. non-mobile devices (see: Arthur et al., 2014; 
vices for noncognitive assessments (Arthur et al., 2017). Morelli, Mahan, & Illingworth, 2014). 
e No differences in predictive accuracy found between mo- e Reliability and speed of internet connection varies in 
bile and non-mobile assessment versions (Kinney, Besl, different places. 
Lawrence, Moretti & Chang, 2017). e Scores on cognitive measures may be lower on mobile 
e Operational characteristics devices (Arthur et al., 2017; LaPort, Huynh, Stemer, Ryer, 
e Wider availability of the assessment across multiple & Moretti, 2016). 
platforms. e Operational characteristics 
e Greater convenience of taking assessments anywhere at e Applicant can get distracted during assessment (e.g., 
any time. public setting, noise). 
e Candidates perceive organization as current with tech- e Screen resolution may not be clear or big enough for 
nology. some displays (e.g., tables, graphs). 
e Larger applicant pool reaching candidates who own mo- e Small screens may increase difficulty to respond to some 
bile devices but not non-mobile devices (e.g., PCs). questions. 
e Lower test-related costs (e.g., unproctored test). e Excessive scrolling can affect assessment results. 


e Assessments need to be constructed for mobile device 
adaptation (e.g., one item per screen) and this could 
incur additional cost and time. 


Applicant Reactions 


Recognizing that applicants are not only potential new employees, but are also current and/or potential 
customers, companies are increasingly seeking to ensure that applicants have a positive experience when 
applying for a job, regardless of the selection platform and/or program being used. Applicant reactions are an 
important source for organizations in the design of selection procedures, and research shows applicant reac- 
tions can impact candidates’ acceptance rates and the public image of the organization (Anderson, Salgado, & 
Hulsheer, 2010). In fact, applicant reactions have been found to be significantly related to applicant attitudes 
(i.e., attractiveness of organization) and intentions (i.e., intentions to pursue the job, formally accept the 
placement, and/or recommend the position to others), as well as test performance (McCarthy, Bauer, Truxillo, 
Anderson, Costa, & Ahmed, 2017). 

Although organizations may not be able to always incorporate the most favorable methods in the selection 
process, organizations could implement steps within the selection process that are popular with their targeted 
applicant pool, such as the length of the test (Besl, Lawrence, Skinner, Moretti & Kinney, 2017). The most typi- 
cal way that organizations measure applicant reactions is through surveys that immediately follow the assess- 


Recognizing that applicants are not only potential 
new employees, but are also current and/or 
potential customers, companies are increasingly 
seeking to ensure that applicants have a positive 
experience when applying for a job, regardless of 
the selection platform and/or program being used. 
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ment or through a postselection process follow-up, although this latter method can suffer from low, non-rep- 
resentative response rates. Implementing methods to tap applicant reactions of the employment selection 


process may offer valuable feedback to organizations. 


Pros 
e Measurement considerations 

e How to best measure applicant reactions 

e Can measure dropout rates at different parts of the se- 
lection process to see what parts applicants may not like. 

e Applicant reactions to length of a preemployment assess- 
ment do not decrease until test length exceeds 100 min- 
utes (Besl, Lawrence, Skinner, Moretti & Kinney, 2017) 

e Operational characteristics 

e Helps organizations get a sense of how to improve and 
retain/gain customers who applied but did not get hired 
since applicants can be or are currently customers. 

e Can provide insight on selection process length, cover- 
age, perception of the organization, any difficulties in the 
process, etc. 

e More likely to view organization favorably and accept job 
offer. 


Cons 
e Measurement considerations 
e Response rates may not be ideal or representative of all 
applicants. 
e Studies delivered in different modes have found incon- 
sistent results (Tippins, 2015). 
e Operational characteristics 
e Some applicants will respond favorably to a survey at the 
end of the selection process just to get the job. 
e Need to create and implement some feedback mecha- 
nism (i.e. survey) to capture applicant reactions adding 
another step for the applicant. 


Conclusion 


As can be seen in the five trends covered in this paper, technological developments and products have 
certainly altered the selection process in many companies, and the ever-present need for more accurate 
and effective ways to select the right candidates will undoubtedly lead to future advances. For example, a 
few additional selection procedures that have arisen in the past few years and continue to evolve are video 
interviews, web scraping, big data, machine learning, and wearable technology (e.g., virtual reality, Google 
Glass). Although there is often the immediate reaction to jump on board and embrace each new product and/ 
or trend, organizations are wise to consider the pros and cons of each big idea for their own use and conduct 
appropriate validation studies. However, one thing is certain: Technology will continue to play a critical role in 
pre-employment assessments and selection going forward. With strong skill sets covering the above areas, 
l-O psychologists are well-equipped to assist organizations in determining the potential benefits and pitfalls of 


each of these trends. 


Although there is often the immediate 


reaction to jump on board and 
embrace each new product and/or 
trend, organizations are wise to 
consider the pros and cons of each big 
idea for their own use and conduct 
appropriate validation studies. 


PROS" => 


<= CONS” 
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